Weighted Orthogonal Components Regression Analysis
نویسندگان
چکیده
In the linear regression setting, we propose a general framework, termed weighted orthogonal components (WOCR), which encompasses many known methods as special cases, including ridge and principal regression. WOCR makes use of monotonicity inherent in to parameterize weight function. The formulation allows for efficient determination tuning parameters hence is computationally advantageous. Moreover, offers insights deriving new better variants. Specifically, advocate assigning weights based on their correlations with response, may lead enhanced predictive performance. Both simulated studies real data examples are provided assess illustrate advantages proposed methods.
منابع مشابه
The R Package groc for Generalized Regression on Orthogonal Components
The R package groc for generalized regression on orthogonal components contains functions for the prediction of q responses using a set of p predictors. The primary building block is the grid algorithm used to search for components (projections of the data) which are most dependent on the response. The package offers flexibility in the choice of the dependence measure which can be user-defined....
متن کاملPenalized orthogonal-components regression for large p small n data
Here we propose a penalized orthogonal-components regression (POCRE) for large p small n data. Orthogonal components are sequentially constructed to maximize, upon standardization, their correlation to the response residuals. A new penalization framework, implemented via empirical Bayes thresholding, is presented to effectively identify sparse predictors of each component. POCRE is computationa...
متن کاملGeneralized orthogonal components regression for high dimensional generalized linear models
Here we propose an algorithm, named generalized orthogonal components regression (GOCRE), to explore the relationship between a categorical outcome and a set of massive variables. A set of orthogonal components are sequentially constructed to account for the variation of the categorical outcome, and together build up a generalized linear model (GLM). This algorithm can be considered as an exten...
متن کاملReverse Regression and Orthogonal Regression in Employment Discrimination Analysis
In a recent review article, White and Piette provide an overview of the use of reverse regressions in discrimination-related litigation. They explain the technique, provide a model application, summarize its advantages and disadvantages, and identify litigation in which it has been used. We point out weaknesses in common uses of reverse regression, some of which might cause serious misinterpret...
متن کاملOrthogonal Distance Regression
Orthogonal Distance Regresson (ODR) is the name given to the computational problem associated with finding the maximum likelihood estimators of parameters in measurement error models in the case of normally distributed errors. We examine the stable and efficient algorithm of Boggs, Byrd and Schnabel (SIAM J. Sci. Stat. Comput., 8 (1987), pp. 1052– 1078) for finding the solution of this problem ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of data science
سال: 2021
ISSN: ['1680-743X', '1683-8602']
DOI: https://doi.org/10.6339/jds.201910_17(4).0003